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Abstract ofWO0117155 

A system aggregates data packets 
communicated between one or more sessions on 
a source system and one or more sessions on a 
target system by: collecting one or more session 
packets from the one or more source system 
sessions; multiplexing the session data packets 
into an aggregated packet; sending the 
aggregated packet from the source system to the 
target system; and demultiplexing each 
aggregated packet into corresponding session 
packets for delivery to the sessions on the target 
system. 
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AG RE GATION DES PAQUETS O'UN RESEAU 



(57) Abstract: 

A system aggregates data pockets communicated between one or more sessions on a 
source system and one or more sessions on a target system by: collecting one or 
more session packets from the one or more source system sessions; multiplexing the 
session data packets into an aggregated packet; sending the aggregated packet from 
the source system to the target system; and demultiplexing each aggregated packet 
into corresponding session packets for delivery to the sessions on the target system. 

(57) Abstract: 

(-'invention porte sur un systSme agr,geant les paquets de donn,es d'un r,seau 
circulant entre une ou plusieurs sessions d'un syst§me source, et une ou plusieurs 
sessions d'un systSme cibl e> recueillant Un ou plusieurs paquets des sessions du sys 
tSme source; multiplexant un ou plusieurs paquets eh un paquet agr,g,; ... transf,rer 
le paquet agr,g, du systSme source au systSme cjble ; ... demultiplexer chacun des 
paquets agr,g,s en paquets des sessions corres p ph dan tes en vue de leur distribution 
aux sessions du systSme cible. 

(57) Abstract: 
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NETWOUK PACKET AGGREGATION 

COl'YKlGiri NO HKlCATtOK 
rVtion* of Ofa patent (ipplic*Ui(iri contain mater ials that are subject to cnrryrtghi 
prolvxlion, The copyright owner has ou objection Id (hi? Jucsmnle icpnnlucuonhv anyone 
of the patent <locimiciit or the patent tfcrclostttc, as it appears in the Patenl and TraoVmati 
Office parent file or records, but otherwise reserves ail copyright right* whatsoever. 

BACKGROUND 

Ine ubiquity of network applications on wide area networks such as the Interact is: 
driven in part by Urn riobustoe&s of corruntmieadori protocol* tliat control the location and 
exchiinyj of data over the network, fn these network*, .uVfomtatJoo passing tiara one 
swocm 10 unother is tron#rmlect from layer to layer a&lna; om or more predefined 
pfOlwals. Wilhin each luy*r/r*edeienrmM*l services or operations are performed, and the 
layer transmiswra irppraoeh ol lew* a given layer Che ability U\ offer selected services & 
other layers using ft sUuWonHra) interface MrJiile *Weldin£ other layers from 
impkmcatalion details in jfcejpvcn lujer. 

Fta example, in orw model called uo upep ^erry inicrwjtuieclign (OS I) reference 
model specified by the tniernu lional Standard* GrpmizRiiun (ISO), seven Uytrx k nown as 
V^ctd". 'data link*, " ! rjctw<irk ,| > , transport"* m ssmum% "presentation* ami "wppti union* 
ln>x»ara spec ritai 

Processes carried om In tiw physical layer are cooccnjcd with the minsmission of 
raw data hi w over a cornmunication cliaruxsl. IVocesaes carried oat In the data link layer 
manipwbOc the raw clnui bit stream and imrtftorm il mln a data stream that apjiears free of 
U-unsmisww errors. The laikr taskis ueeomp&shed by breaking the irnn^rhtued data into 
d«a frame* and uanamlttiug die frames sequentially accompanied with error correcting 
rnechanbans for detecting oe corrtcdh^erforiL 

Network layer paw*** determine how data packets are routed front a data 
Mmrce lo a dam tteslinntion by select big one urrn*ny viternaii v* pull* through the 
network The function ol'ihe troixptirl layer processes i« %> accept a data stream from a 
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session layer* *p*u it up into smaller unlm (If necwsaiy), pass these smaller unils to the 
network layer, and lo provide apprortfiaie meclurolsms k>. ensure that the units all arrive 
cciTCcdy attbc dcsliiuitiwh, with no KquCturing terrors, dupllcaws or missing tlalu. 

Session layer processus allow user* on dilfcreot machines 10 establish \cssiwi*" or 
M dialc»gK«r between themselves. A session allows ordinary did a iran^ort between the 
vommunicaring nodes, but also provides enhanced services in some ujn>!3carJoji*, snch as 
dialogue eoxioxil . token management and synchronization. Presentation layer protases 
perform certain common lonaions Una am requested sufficleivtly often to wiirraM finding a 
ge lien) foiution for them ibr cranple, caw>uingd>4a Into a standard format pcrfur*nin& 
encryption and decryption and other functiorti. 

Finally, die application protoco' layer processes handle a variety of protocols lhai 
me commonly needed, such as database access, fdc transfer, among ntlteis. The layers arc 
rnnmged In older to form a protocol "stack* for each node and the *acH are connected 
ioscUjct m Lhe nfcyalcat level end. t hus, dam transanission through Iho network consists of 
passing Monnauon do*u tfiroueji one stack hi a source system across lb* physical 
communical km Hnk to another protocol stack and passing the information up me other 
stack to a largtt system. 

In one protocol e^ led th^ Protocol 
(TCPflFK a aiwiblc, cwn«ilioti oriented protocol over (oe encnpsiUatal vdihifi) f P is 
provided. TCP j^(araniee» the delivery of packets, ensures proper sequencing of the data, 
and provides h checksum r^ulure trut validates both the packet header and ils data tor 
accuracy. The protocol specifies How TCP software dlttlngufches among nmluple 
destinations on a given system, end how comnumjcwiirtg systems recover from errvrs such 
as lost or dupJJcamd packets. It provides a bcst-cJlbrw connci^K^UKs delrvciy system for 
r^rvtpnw A*t* TOP/II 1 la a four-Jaycrcd system with an apphcauon layer, a transport 
Uycr, a network layer, and a u'uk layer. In "TCP/IP, each layer has one or more protocols 
for consummating wilh its peer at the same layer. For exaniplc t two TCP layer.* running 
on a network, can commumcaue v»)ih each other. loe hard ware details assucuiled with 
physically liHsrfaciRg with a caWc/mcdia am defined ui lh« lmV layer. The network law, 
someUjoe* called the Internet laycr^ bandies the movement of packets arourwl du» nerwesk. 
The micrnci protocol provides the artwork layer, lit die TCPflP protocol suit*. Ute 
transport layer provides » How of data between rwo hosts for die application la>er above. 

2 



28-4 



WO0V17155 



The upplkato J«y*r handles the dotaJis rtf the parckutar ajipllcatlrtJi. .fi>»mplcs ©fine, 
application layer include remote login applications such sw telnet, file transfer protocols 
(FTP) appucatioiL nod foe simple mat! transfer proaxol {SMTP} far electronic niaiU 
among others. 

When an application sends data using TCP, &c date is scot down u protocol stack 
through mcK layer, nntif the data reaches the pb>*sieat la>rr where it is scnl »s a slnsani of* 
bits across a network. Hath layer adds {information to the data by prrpending headers 
and/or trailer inronrMiim to the received data. The daia that 1CP sends to I? is called a 
ftp segment, whik mc data thai IP sends K» toe network mtcrl'uw is called an 11' 
datagram. The stream of bytes thmflows acr ossihe network is called » 'time. When the 
frame is received ax a des&iatloa host, the frame works its wry up the protocol *tack. 
Along ihe way, the headers or trailers are removed by appropriate protocol hungers. Hus 
b done by examining kleniifcrs in the headers or nailers (demultiplexing). In this manner, 
packets van be suraamed one ac ttroe fhom a source to a dest'tnaiion. 

The iransrn wion onndivJdtiaj packets over the network adds conaaunication 
overhead lo the protocol handler* such a* the cose to Issue a network so^rccdvx^elcel 
system call lo rvad/wrileAwiV Tor each nenvnrk packets. Nero?ortc packet aggi^^ 
be used to rcducv the eornmunication overhead io a efletr/stmr confl^^aatioa This 
technique t>pical)y uses r shared buffer that aggregates the packets and adds -various 
hcadcrsnraiicrs to the Rjfgrejfulcd packet prior to transmission. 1 f owever, for systems that 
transmit small sued network paekels such a* ihosa in a cilent-server database, the pcr- 
packct processing cost to send or reewye u ociwprX packet jwch m the cosr a* handling 
headere and trailers becomes Im^ relative to the mviond's per-byie processing cost. 

SUMMARY OF THE WYEKTIOK 

A sysfcm aggregates data packets communicaicd Between one or. more sessions on 
a source system and one or more sessions on a target system hy: cnl lectins °nc or more 
session packed ftom the one or more soon* system session wmultfr^exing tlw session data 
packets Into en aggregated packet; sending the aflsrcijatcd packet from (be source system 
to the lurgct system: and demultiplexing each aggregated packet into corresponding 
session packets for delivery, to the sessions on die taiiaec!sysQeoi. 

nnplen^cntarjons of the invention include one or more of the following. The 

3 
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metJtod Includes reading an aggregated packet header for each ajjcrcgnicd packed 
allocating one or mow network bnffcrs based on the aggregated packet header: and 
scattering tha session packets into the one or more network bailers. The method also 
includes generating a packet header based on the one or more session packets; and sending 

5 the packet tender umhbe sexton packet* n uv? *%gn?gaie<( packet on a data .transport. 

The method can uJso include w^nbining multiple pwfcct headers into an a£greaa£ed packet 
header; sending the abrogated packet header ow one or more control transports; 
combining multiple session packets into an aggregated data packet; and sending the 
aggregated data packet over one or more dam transports. Additionally, the method can 

10 receive the >q&Tegukd packet header frOrn the control transport; and for each packet 

header received from Ihe aggregsied packet header, allocate «ne or wore network Imf few 
based on Ihc aggregated packet header; receive the nggrcgv let! data packet; and scatter the 
aggregated data pat*c4 iruo fee one ox mote network otiflmbti**! on inlbnnadon from 
the aggregated packet header. The packet a also becusc^d ihaiis, a 

15 cascaded session can aggregate data from a previously aggregated session am! forward the 

aggregated packet to a concerrtrwor downstream wi>ich in turn performs HiWiii urKii 
aggrc^on oti the aggregated packets in a cascaded fashion. 

In another aspect of &einvcntbn r a method aggregates packets for transmission 
from one or more sessions on a source system m one or more sessions on a target jow 

20 c^hr^etltm'ingao^uoitioo Thisisdonc tyvolkcfuigoiteor 

more packets from the sonree sj«tem; agaragating the header portion of each packet and 
one or more data portions into an ag#egaied packet; tranamming the aggrcptcd packet 
to the target fcvstcm; exiting the header portion fnim the aggregated packet; and 
derfiuhTplexing the one or m ow uul u purri cttw rnio corresponding one or more sessions on 

25 the target system based on Iteheuder portion, 

nuplcmanaaons of mis aspn^ inelueV one or more of the following Ine 
aggregated heade r U transmitted together with one or more data portions. Multiple packet 
headers can be emnh i rted into an aggregated packet header. The aggregated header is 
imiwnitted over one or mere control vfcarmeis, H* daw portions are cransmined over 

30 one or more data channels > The dcimUtipJcxmK executes one or more operating system 

mpiu/ourpin calK i he collecting step performs user input/output multiplexing: 
Moreover, each session in a database session, an Internet Protocol (IP) session, or an 
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opcratir.R system stream. 

Advantages of tlte Invention Include one or more of the lolloping, The invention 
improves the utilization of tiw network barvlwiULh by aggregating network ptiekcts 
unrelated diem, session s.'usersu> reduce the commutes lion latency as vvctl as the resource 
5 i^iiireinenw to handle «m»U sized network packets AddtttionaUy. the tovemioii obviates 

Ihc noedte perform data buffer copy operations to Implement network' packet aggregation 
at die application layer dmc would be olhenv&e necessary achieve packet aggregation 
across client sessions. Further, tlte invention evokb resixnce expensive InpuUOuipXiL 
Multiplexing Operating Hystctn colls such us SelceiO* PoHQ. and lOComplctionPurtO 
1 A syKiem calls traditionally wed by server processes to concurrently service multiple 

network client*, 

Jjytfern perfoimanrc kenhemcod since die number of operating system calls needed 
1o send and receive data over the network to reduced. J^ooower loading h reduced due to 
icwer 1*0 operation* Network packets can be aggregated even In relatively small 

15 oorifigoratioiw since ngfircgation reduces network latency. The aggiegatinn of tl» 

ncrwDik packets, along with the minimization of expensive tiflb multiplexing calfa reduces 
the processing resource rcqunvmentson the .server. Hv aggregating network potion*, tne 
invention amortizes and reduces the network cnmm'unicaiwin overhead such as the 
overhead nssociatod with Iwsurng network Rend/Teceivc^P?r»y^ern calls. Moreover, the 

20 1*0 ronlriploang is perfbnned at the user level, which vliminuti^ eKp wive 09 kernel calls 

to poll the rranspora to deiea arriving packer. 

Overall system complexity i* tedticed by avoiding complicated schemes such as 
buffer sharing. The invention provides high paibmiaacc without requiring additional 
pmce&or and memory resources for copying data. Hcucc, the scalability of the saver is 

25 improved, 

Oihcr features and advantages will become apparent from the following., 
description, including the 'drawings and the claim*. 
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BRIEF DESC1UETION OF THE DRAWINGS 
Fig, j is a flowctort of a process for performing network pneke t Rggrcgolion. 
Fig. 2 U a Week diagram ilhutiatins nn embodiment for encapsulating ptu&sis 
between one or mow? source sessions and one or more remote target sessions, 
5 tig. 3 in a block diagram Illustrating one e>i)odirrtent pi>i*erwork packet header 

in accordance with Ibe ravcniiojL 

Tig. 4 is a block diagram illustrating one cmhodifnenl of a protocol data unit of 

Hg.3. 

r% 5 I* a flowchart Hfustratiug a process to send or wTitc an aggregate network 

10 packet. 

Fig. 6 i* a nvtwehart of a nrnw^ for receiving or wading an aggregate network 

picket. 

Fig. 7 is u second embodiment or nprocen for fceadirig or writing an aggregate 
network packet;. 

15 Fig, & » a second embodiment of u pntcesi for receiving or reading an aggregate 

network pocket 

Fig. 9 a a diagram illustrating ■ wide una network system \uib 1he rwawtirk packet 
aggrcjjRtlon performed in Figs. 1-8. 

Fig. 10 is aacVcxnatk diagnirn ofacoraputcx ibrsupjKHl^ 

20 

DESCRIPTION 

Referr lag to pigs, t and 2, a proccaa tOQ for ncrf ocming network packet 
aggregation over one or a\tttt client session* is shown. In general, a packet rormat or 
frame format refer* to how data ta encapsulated whb various fields and headers for 
25 umrnmon acrtw* a network. Vox eKnmple, a data packet typically include* a desruutioa 

adtUcaa field, a tengfc field, un error wnvtiv&.codc (iiCQ fiehl or cyclic redundancy 
clicck (CRC> field, as well as headers aid footers to identify the beginning and and of the 
packet 

in Fig. 1. one vr more twara or *essior.s at a source system 1 1 0 (Fig. 2) establish 
30 one or more connections to conespondinjj sessi cms executing on a target system 11 1 (Fig. 

2Y The session* may rmt directly on Ihe sottfvc aysicro 110. or tiUcrou lively, may run on a 
remote system (not shown) whose correction requests have been transmit ic<l lo Che 
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source system HQ. In one embodiment, on? or more sockets arc created during the 
establishment of the euimceuoos. Ccncspondirn; addresses or pwr numbers arc bound to 
tte sockets, and connectioiis are initiated using contvxt ealls. 

Once Cic coimectious cue established, data packets nje sent from sessions on the 
S source system 1 10 to session* on the carpet system 113. 1 W source syMem 1 1 0 receives 

the data packets and muhiplexeK toe data packets into tin ajflaTtfuiedpwXel, wWch can be 
eommtitiiutttotl with minimal transmission o\rrhcad (step 102). The aggregated packet 
conuuns a plurality oTdata packets, as well as information needed to demultiplex the 
Bgjpcgatcd packer at the target system 111. )n the embodiment of Kig . 1 , the s^cnsied 

1 0 packets are then sent from the source system 1 1 p to the target system H 1 using one or 

more operating system mptnVoutput call* (step 1(H). 7 "he u^ri&guied packets are then 
distributed o\^r a plurdity of data frame* and seni over* net wv*k w I lie target system 
1 11 . When the data rratnea are leeetved MVJhe target system J 1 1 , the data rmmesore seta 
to a proVicol w&. I leaders c^lamcd in Ibepuckel* are removed by one or mote 

1 5 wptKsi ve protocol handler*. Eaeh protocol handler examine* certain identifiers in u 

packet's header to <Wlcnninc whu thcr il should handle the packet or should forward the 
packet hi the next layer. The target system 1 i I receives die ajzgrcgKc packets or data 
(step 106) and demuUtplcxcs each ngBW^'W^'^ its constituent sub-packets for 
delivery to Ihe target sessions on the tnrj^ system 1 1 1 using one or more operating 

20 systeniirHmiA)u^caaa(wcp 108), Inor*cinbc4h^ni,^ 

seatlcr-gauicr interlace is inyoked. This embodiment receives die aggregated packet in 
one or more network, buffers. Headers are the a generated for each client session packet to 
rciantcrmc the packet r^gilralry generated ol the source system 1 1 0. An operating syntnn 
provided scarttf-gatfter Interlace such a& writes*} in called once u» gather the output dau 

25 from an inpui'outpui vector and to write d»eaggre$uied packets to a irunspOrt endr*»m 

such as a wekel. The aaltcr-j^uiier inusuice allows a one step distribution of the 
individual session pavkcl to its destinnuon on the target systan 111. 

Figi 2 shows hncraeiiocs among various kycrs associated with the source system 
110 and the.:argei iy?«em i U in aanefatine aggregated packets and in denmltiplexlng the 

30 aa^t^iinipaekets. A .plurality ufcKcnl sessions 1 1 8 and 119 send a plurality of session 

lUitu packets which arc combined into a session layer aggrwted packer 120. The client 
sessions and 119 can be database sessions coniruunieating queries to and responses 



28-9 



0117155 



WO 01/17155 PCT/USU0/2426i 

fnjm a database* server. 

Tho wJsshwi layer ao£r*$ated packet 1 20 Includes one or more aggregated 
Transport Level Prolucol Datu Uniw CH^Wst), , along with v Network Pnmicol Data 
Uhil (N&PDU) header. The NeiPDU header describes the number of TLPDUs that wl 1 1 
5 fo] low the header on the given transport The KctPDU precedes the TLPDUa that it 

describes, and contains enough irdorrnstloa for sub^neot layers to demultiplex the 
aggregated packer. In one embodiment, the aggregated packet header b fixed In Jength. 
Hoover, the rmytijTHOTi e^gcegfliton <ir/e (and fence the maximum packet header length) 
is neyotiHbK; ai the physicul transport csUiblwhincin time. 

10 "Hie scseioddata, which is shown cxempiarily as TLPDU1 and TLPDU2 m ihe 

scsjUon layer aggregate packet 120> and ilie NctPDU header arc then provided to a TCP 
layer 12*. At this layer, a TCP header is added to ihc aggregated packer in addition lo (he 
Netl'DU and the nesskm data, The TCP layer 122 Is then provided to an IP layer 124 
which Inserts mi tt» header Into the aggregated packet previously emitted by the TCPlaycr 

15 122. AUhe physiou network ^ 

a$f/egated packet is uxuttmtaedover a network 1 M) as one or owe frames of data. 

The frame* carrying the aggregated network packets are first processed by a 
neavork frame handler 1 3Z *ITw network frame KotKtler 1 32<arips tt* netwoik header 
iWmnsich Vntme trod lorwardt the nssullinj; puckcl 10 the next layer, which U the II' layer 

20 W. In the IP luv^r W, an IP datagitmi handler .searches for an IP header and jemoves 

ihc IP header before torwirdingllic dcmqliiplifxed}^ckflK= omwinl lothe next level, die 
TCP level 1 36, At the TCP level 136. a TCP scgmciu handler examine the packet* 
forwarded to it and locates a TCP hcatler irom flic data packet The TCP header is 
removed and the insulting data packet is then forwarded to a session layer 138 where an 

25 aggregated packet handler strips the net PDU header from the data packet and uses 

information from the NetPlXJ header to demultiplex the data packet and provide data to 
the correi^nding target session* 13¥ and 140. 

Rei&iing new to Fig, ?. an exemplary daia slrueiure of ibe NeiPHU 2IK) i* shown 
indctail TocNetIt>U200irjdndc«ahc^ 

3U length field 21)4, n Pl*l J-sent count fle*i 206, a rlae field 2UX. and one or more transport 

levd pnu»(TLPW?> 2lb v t1)elYeaoerler^tli Held 202 is'nptlonal and allows the 
network upplieatron to lugpoliiile an increase or decrease in the si /e of die lieader; lo 
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crobourmcrii* where the header length i* constant, ibis field U unnowssuiy. The tnul PIXJ 
length field 204, which is also opiicmnl. stowv in rwnuilkici nbcul Che total si« of the 
header plus the tfixe or Ibe uUuchcd dalu. The mFermution «1)oms the network lo cross- 
check the -result of the data trtwamisaon. The PDU-scnl count field 206 provides 
5 Information Quit can be rued to indicate the nuinbet of incoming 1 1 J'D( /a. The flajt field 

208 roay be wed to wort state information. 

An eaemnJary data structure of the Tl .PDU 21 ft r3 ahown in more deled! Irt Hig. 4. 
The TtPDU 210 vontuins ;\ field 222 for storing one or more Hags such na urcqucu type 
flag. Also, the TLPDU 21 0 contains a field 224 for storing a session number or chem 

1 0 Identifier. A field 226* stores packet sequence number information, while ti field 22 8 stores 

the ' I' W l> I " size Information. The oprianai field 126 is useful in reassemb.ing the packet* 
lorn a predetermined sequence, whan more :han one transport is used: 
•n» fiad22a pmvlaes more Inftwinatkm on the TIJWi; size. 

Referring now to lift. S v a send process 300 Is shown for «ndtng or writing an 

1 5 nggTCtfnled network packet The process 300 HrsL collect* w i^ivcit'Tt iT3 t; ?i to b© sent 

io # server (step 31)2). Thix step ea« he tmfdcmtfnted usiruj one or mere dedicated threads 
10 rtovivc mtwnj&if paiAcU u/hJ usher Ihc packets imp a queue. The queued packets ara 
ihenaweetucd. Next* the proce** 300 j^enaw u lixeu kngCb network protocol data 
unit flvciPDU) or packet totsetl on Ihc queued ILRDUs (step 304). irrnurt thaim one 

20 uanstwrl is nvuihibk. Ihe prove** 300 then limlsn ficc-or idle irwcport siream. I r mall>v 

the aclvwrk packet header and corresponding TLPDUs art* scot over the nci worJuwins an 
operating system h^ output guncr rntsitacc cailfstcp^Oo"). The corresponding 
pseudocode to sendWvrite an atfjjrc^atc network packet u as fbllowv: 
1 ) CollecfTCecctvc all TU'DUs to be sett to the server. 

25 2) Generate the fixed length NICIIDL or racket header based upon the 

abowe 'll.p'DUfc 

3) Send nienetutnl: packet h^^ on 
the chosen transport. 

4) The netwmicrraketheaderaiKim^ 

31) uvcr the network using the < provided K> gather / truer lace -(examjtle: wrtteyO); 

"rltfcrring now to Fig* 6. a process 310 rorreeeiviag erreadir% wptytio 

9 
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network packet is shown. First, the process 3 10 rath a fixed length pookcl bender 
KctPDU using u ncl*H>ric read or receive interface on a given transport (step 312). Next, 
the process 3 10 «)lo<wj1e» one ur mem: network buffer* based on the N'etPDU rnfornnUwr. 
extracted rron: (be header section (step 3 14). Finalt>vHw pmcess 31 0 uses an operating 
5 system provided scadcr/gathcr intexfece 16 <1 wtribute the TLPDUs into multiple network 

butter* (step 316). Lite. pseudocode to rccave'read an aggregate nciwdHf packet is as 
follow*: 

I .i Raid uV fixed length packet header N£TPDU using the trafitiomil 
network readfrccv hucrfsoo on die given ihinapmt. Cite additional cormnunieti&m 
10 rcad/rccciw will be ncccawiry forttttdirig m the fH&^ated packet header for each 

aggregated packet. 

2) Allocate network buffers based on the inromwlion contained In the 

3) Use tlie OS provided scatter rmcr^fcxampte; rvedn) system call) to 
1 5 .scatter Ute acioal user date or 11 J'DUs into the multiple network butters: 

Turning now in rigs. 7-8, the processes shown dttrehr implement a second 
proiocvil where one ucnmr* denJcaled control transports are used for cxchapgirig rocker 
headers only, In other words, multiple NetPIH are farther aggregated and sent over the 

20 dedicated cunlrol transport^) tn the server to reduce the cumber of rcad/iccvive OS 

communication calls required for receiving multiple packet headers. Due to use of 
dedicated control trimsper.*, .^^pA-h^r{t4AmV:t) can nmv he of variable lcnglb 
for even better udHzation of network bHadwrJih. Through the second protocol, tbc server 
polls fewer control transports. If the number of conlrul transport* is small dten the poll on 

25 tJw comroi transport can be reduced -to a blocking or non-blocking nebvorJc read/receive 

OS coil. 'Jrms, the cost of using an 10 multiplexing mtcrfacein the server (example: 
Sslecit) or PollQ) cun be reduced or even eliminated. In th is ctabc^irnerit, Ihe NeiPl 31 J 
contains imormalion on which data transport the corresponding TLPDDs urns sent on- 
Referring now to Fig. 7; n second send pruecio 330 u shown. In this process. 

30 Tl A*Oi>* are collected or jeceived from serious clients. and consoiK) tiled he tore cliey are 

sent to v server (step 332V Next, a particular data ranspo it system is ioenulled (step 
354). Tby TLPDUs are then sent on the selected data uaf report system using Ibe operating 

10 
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sysrcm input output .gather colls (step 1 he process 330 ttwn fcetteiates ooe or more 
NctPDU packet headers (step 338). The network packet header NetPDl J 340 are sent on 
a control transport wing one communication call (step 340). The pseutkuxKle to 
aetxL^vnte an aggregace network packet In as follows: 
5 1) < loJIect/Receive all HOTUs iiom Clients to bu scat to &c server. 

2) Idenuly « particular Data Transport to be used for sendma; die TIPPUs. 

3) Send the TLPDUs on the chosen Data Transport using the OS provided 10 
gather interface (example? wrhevt)} 

4) Generate a NKp'Dl J or packet Iveoder bused upon the ubuvc TtPOUs 
) 0 chosen transport U>. 

5) Send the neiwotk packcl header NETEDU on flic Control lYansport using I 
wndftriic twununicutioa call. Alternatively, the NETPDU can also be enqueued 
nuo a header queue 1o ^regale the hcadcra to reduce transmission wcrlicad. 

15 Turning now to Fig. 8, a second cnibodlrocm of the receive or read process 350 is 

shown, The process 350 first reads the nltmdlty of packei headers on die controlled 
transport using a network receive interface eaU (seep 352). N ext for each header, the 
following operations arc pcrf<Hrncd (step 353): one or more network : buffers are allocated 
in accordance with the subpackets cooraijied therein (step .154), at id the operating system 
20 provided nitcrfscc on the data transport Is used to distribute the Tl PDLs Into die 

allocated network buffers (step 356). The pseurfn code w Receive/liead an agareoaie 
network packet U as. follows: 

1 ) Read moltipl* packer headers (NCTPDUsVon Ihc Control Transports) uaiog 1 
network TeuuVreeinve inUrriuce- 
25 2) For «jch header- 

3) Allocate nctvwrk boflfcrs based oh the lafonnatlon contained in the given 
NETPDUa.. 

41 Use the OS provided scalier irrternW^wiuple: readW) system call) to 
settler the actual user duto or ILPDUs into the various network buizerc 
30 from Hie given Data Transports. 

The processes of figs. 7*K receive multiple NelPOU* or pocket headers on a 

J] 
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dedicated cannot trmuport using a single conummicalk>n w^ ; rw*iyeeuH. The use of a 
dedicated control transport to scndtoctivc packet benders allows the server io Avoid using 
the cK\m#i>rt K) multiplexing Interfaces (example: setectf) or polK) system oa^ls). The 
vusvol' receiving network packet headers is recjuced, thus Improving the efficiency of 

5 packet kggnrgotion. Moreover, \b&* processes enable useoapollcarJon level VO 

rrmlttpicxing %nthout twinfl the OS provided I/O rnu lliplcxing interfaces. Additionally, the 
variable length packet headers keeps the packet header overhead (in terms of number of 
b>tes or* additional data transferred) to a mhmnum. 

r%-9 Ah*w* ari aidjitifitcturo which takes advantage of dtc network packet 

10 aggregation system flsvui^l above. I he system 4W> Iww a pluialhy of source or clicni 

sessions 402 and 404 which need io eutnmamcutc data tn one or mora career sessiens 422 
and 424 over* ncrwork 410. The dula from the source session 402 and 404 ore collected 
at a source system 406 which tu^grcgatcs the duui in perfurroins an efficient network 
packet aggrcueuon across client sessions* The source sy stem 406 consolidates tits data 

15 from die data source sessions 402 and 404 and transmits the resulting data over the 

network 410 to a target system 420. The tared system 420 in Ion distributes the data 
associaiad with each session in aceoidancc to the processes discussed ubbve. Ihe packet 
segregation can also be cascaded* that is* a cascaded session can aggrcgute data from a 
previously aggregated session and forward the aBRrc^atcd packet to « concentrator 

20 dnwnsueam which In mm performs additional aggregation on the at&regitfed puckets in a 

cascaded fashion. In Pig. 9, the wwrce system 406 can be a transient target aystcovlbr 
anotlier source system. I n such a configuration, the concentrators can have an invert cd 
1ree cunliguniuon. 

Ihe protocols discussed above are als» Hpplicable to annje&ating packets at the 
25 TCPflP layer. In this context, many Cnix opcraling sysletruprovitfe STrREAMS 

miuoplcxor s, which arc software device drivers to route mcssujge* between cirrerent 
streams. 1 nese multiplexors can be used to isolate the oansport connection's stream from 
the oeiwvirk LwtnwlkMi't. sareanL YCY and t JDr ruYrtocols are implemented us 
runny-to-one multiplexors while IP U implemented as u niany-to-juairy multiplexer. 
30 The packer aggJt^wion can be done in the context of STREAMS based itlVJI' 

usbtg an abnegate SlftKAMS multiplexor which ii petitioned between TCP and re 
drlverf A c«»rre#pe4uKng peer culver is also used on a target host to split and reroute d* 

12 
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aa$m^ntc4 messages correctly. The S* I'llliA MS driver receives inputs irom TCP and Ibcn 
aggregates the packets going to the same IPoddnws, The aggregated packet will be then 
routed to the IP driver. 

An. pockets are encapsulated, the IP protocol would not be aware of tbc packet 
5 afca/e^ailon. <)n thetarget hoi4. the IP routes the aggregated packetm a new peer driver, 

which will take the aggregated pnekct from II 1 drhw, spirt and route the packet a* 
specified by the aggregated packet header. 

Tbc protocols discussed above ^nilkuntly reduce the munber of operating system 
communication calls. Cldrrej*«mdmg)Y. the number of communication calls occcssaay to 

10 send and receive a giveri mimber of network packets between the source j^scem 

(cunctmtruUir) and the I urge I ayston f server) processes across trie network is also reduced 
due 1o packet aggregation. The icsonace requirements of the server process wil I be 
reduced proportional to amount of average ae^y eaarion rtieaxined. The-nsduceaJ number, of 
wmmimicalion calls needed in the Server will improve the vcnl«C»iluy of the server in a 

1 3 client -server ardmcctuic. For small slaed packets, pu&x\ uggrvgulion helps improving 1he 

network bandwidth doc to the reduced packet/frame homier overhead ut the Intra port or 
lower layers. Moreover, hi networks with large MTU (Maximum TraremusdonUiiiO 
aggregating small packets reduce eomriiiiueutiun tourney. 

The invention may be implemented in digital hardware or computer soitwarc, or a 

20 combination of both. Preferabry, tbe in venUun ia implemented in a ccsnpoter program 

cxccTuing in a cmnputer svffiem. Such a computer system may include & processor, a data 
storage sysajm, at least one input device, and an output device ; Tigiue 6 Illustrates one 
aucb computer tyxtem 600. including a proccssoT (CPU) 610, a RAM 620. a ROM 622 
and art WvuntroUer $30 coupled by a CPU bus 'the I/O controller 6301a also 

75 coupled by un VO bus 650 to input devices such as a keyboard 660, a mo use '67ft, and 

output devices such as a monitor 680. Additionally, one or mere dulu storage devices 692 
is counccted to the I/O bus via an Ut ) interface 690. 

rmther, variation* to Uw busie wagnter ayatcm of Figure 6 arc within the scope of 
the present invention. For example, instead of using a mouse a* u*ef Input device,*, a 

50 pTvssurc^scTisjave pen, diejibev or tablet may be used. 

The above Described software uao be implemented in a high level procedural or 
objcW'Orientedpni^mmmifig language lo operate un a dedicated or anbedded sy3:cm. 

U 
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However, ihe prograirw can be implemented In assembly or machine hmouaae. If desired 
In my vu*d ihe language may he a compiled or Interpreted langyag*. 

Each such computer prugtam eon be Riored im * sium^e medium or device 
CD-ROM hard disk or nw^nciic diskette) thai b readable by h gwivrilpr spwaal purpose 
pro £rwn triable 

computer wr configuring nod operatinjrthc compute/ when the storage medium at devioc 
is teu&l by the computer to perform the procedures described* the »y«em also ojay be 
implemented aa a 

computcr-rcadiiblc sloragc mwJium. configured ydm a computer program, where ihe 
storage medium no configured causes * computer to operate in a specific and predefined 
manner. 

White me invendoa hss been shown and described with reference to an embodiment 
tliereof, those skilled ia the art will mdcratand that the above and other changes in form 
mid detail may be made without departing rwra the spirit and scope of the fbi lowing 
claim*. 

Oiher emhodmienu are within the scope of the following claims. 
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WHAT IS CLAIMED: 

1 . A method £br aggrogarJ ng dan packets communicated teiweeu one or more 
session* on a source system and one or imvm asMipris oo w uwgrt system, comprising: 

collecting one or mows session pticfoc;* &gim Ihe one or nwrv sotrrvc system 
3 serous; 

rnultfpiufcing the session dace packets into an aggregated packet; 

sending the aggregated packet fironvthe source system to the target system; and 

demultiplexing each aggregated packet into comrspimtUrtg session packets i'vr 
delivery to the session* on the tm^ct svsl tm 
1 0 2. 11w method of ehum I ..further coruprisinir; 

rmtfmianasgrcplcd packet header for each aggregated packer. 

iilloeading one or more network buffers based on the aggregated packet header, 

and 

Bcuitering the session paekca into the one or owe network buffers. 
15 X Thcmcihod ofcMm 1, further comprising: 

generating a packet header baaed on the one or nwvre session packets; and 
sending the packet header and the sejwl mi packets aft the aggregated packet on a 
data transport 

4, The method of claim l T ftiither comprifang: 

20 corubmbig multiple packet headers into art aggregated puke* header; 

sending the aggregated packet header o ver one err more comurf transports; 
combining multiple- session packet* inlo axj eggrv^led dais packet; iwO 
sending ihe nggre&aieci data packet over one or more data totnspons. 

5. Hie method of claim 4. further comprising 

1$ receiving 'the aggregated pocket header from the cojutoI transport; and 

ibr each packet header receive tr» agg/egated rttikec header: 

allocating one ox more network buffet!* based on the aggregated packet 

header; 

receiving Ihe aggregated data packer; and 
*0 acatteringthc aggregated data packet J ran the ope or more network buffera 

bused on informaiiojv from the aggregated packet header. 

6* A method tor aggregating packers for irtinsrnixxitm frym one or more ses*iorw cm u 



15 



28-17 



0117155 



WO01V17I5S FCTOSWOW4 

source system to one or more sessions on a target system, each pacta having a data 

portion and a header portion, comprising: 

collecting one or more packets from the source *\«tem; 
aggregating the header portion of each packet *\d ai* or moce data portion* Irao 
5 an aggregated packer, 

miasrmilhig the aggri^aicU puckevio the target system; and 
extracting the header portion from the aggregated padect; and 
dcmiitipladngthc one or more data ponloiu Into corwspondjng one or more 

session* on the target system baaed on the header ponton. 
10 7. The method of claim ^ vheretoi tins aggreguicd header h trwwmitiea t/rgether wl:h 

ine or more data portions. 

8. The method or % clairti <k further comprising combining multiple packer bender* Ma 
un fl^rjjaled pNvkeihender. 

9. Ihe methotl of vlwim 8. therein the aggregated header it trainanittcd over one or 
1 5 more control channels. 

10. The mcmc4of damovwherante 
data channels » 

I i , The mtfaod clmni 6* wherein the ccronlriplexing executes one ormdre operating 
system kipoi/ourput calls. 
20 J2: Thcincthodof claim 6\ wherctnthe collecting step r^ifomisusermprttoutput 

multrplcxtng. 

1 3. TbemetJtoaqfciarm 6, wherein each session is enher adauban.sefrion, an 
Internes Protocol (IP) session, or an operating system stream, 

1 4. i lie method of claim h, wherein the nggregttiog step iscasetulcd. 

25 15. 'fh* method of eUrim 14, whereio h cascaded, session transparently -uxgreifui w data 

from a previously 
aggregated session. 

1& A system to agarcgatc data packets coiminmicated het*een one or more sessions 
on a sonreo system end one or n\ntt *e«»cm$ on 8 Urgcl system, comprfeintf ; 
30 mv*ans for coHcetinji one or more session packets from the one or mere source 

system sessions; 

means for rtmlrfplcxmjj the session data padceo Irao an a&a/egated packer, 
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means fbraendii^tbcBKpc^aicd packet from ihc source ^cm tt» the target 
system; and 

mean* for demultiplexing each aggregated packet into corresponding session 
paekei* lor dV;W-ery m the *eKs"trtrts o* the target system. 

1 7, The Jtysncm olWim 1 6, further comprising: 

means for reading an aggreaatcd packet header Tor each aggregated packet; 
means for allocating one or moic network buficrs batfed cm 0* ugsieguled packet 
header; and 

ipeuiw for tottering rhe session packets Into the one or more network bitlTcre. 

18, The salvia ol vJin'fli to. r«Tth^cOjnpriAirti: 

generating a packet header hated on the one or mwe sesskm packets; and 
fxndniathei^to die session packets a* the aggreoate4packn«ia 

data transport 

19, The system of claim 16, further cornprijsmg: 

means for combining multiple packet headers into im »Kgn?gajed packet header; 
means for sending the aggregated packet header over one or rnore corurol' 
transports; 

means for co mbfaiug multiple session packets imo Hn tqfigr*gHU*l data packet; : and 
means tor sending the aggregaced data packet over one or more ihd* itWwpOit*. 

21). The system of claim 19, farther conmrising: 

receiving the aggregated packet header from the control transport; and 

means Jor per form I ugtlw ffiUonlng ©juration on each packet header received from 

Uio uggrc^ttted puvkci header t 

ellottadng one or more network buf fern based on the aggregated packet 

header; 

receivmjjthe aggrcifatcd data paekeUand 

scattering the aggregated dam packet into da; one or more network hu/few 
hased on information frrun the aggregated packet header. 

21. The aystcmof claim 16, wrwmm t«i^^m^ nieaia iscascaded. 

22. Tlte system of Claim 21, wherein the aagrcguling encuny bottles packets from a 
prevloqflly aggregated session. 
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